Skip to content

Add clickbench-sorted benchmark - #8559

Merged
AdamGS merged 2 commits into
developfrom
adamg/clickbench-sorted-benchmark
Jun 23, 2026
Merged

Add clickbench-sorted benchmark#8559
AdamGS merged 2 commits into
developfrom
adamg/clickbench-sorted-benchmark

Conversation

@AdamGS

@AdamGS AdamGS commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Summary

Adds a new benchmark that is a Clickbench derivative, using the same data sorted by ("EventDate", "EventTime", "WatchID"), and only the subset of queries that use the sorting.

Its worth noting that even with the extra time spent sorting the input data, its still faster than the full clickbench run.

Results

Seems like it fails because there's no baseline, but the results are:

┏━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┓
┃ Query ┃ datafusion:parquet (base) ┃ datafusion:vortex ┃  duckdb:parquet ┃   duckdb:vortex ┃
┡━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━┩
│ 23    │                     4.81s │   674.3ms (0.14x) │ 138.5ms (0.03x) │ 178.7ms (0.04x) │
│ 24    │                    32.7ms │    17.7ms (0.54x) │  20.8ms (0.64x) │  27.3ms (0.84x) │
│ 26    │                    32.5ms │    16.3ms (0.50x) │  19.0ms (0.58x) │  47.5ms (1.46x) │
│ 36    │                   180.2ms │    60.1ms (0.33x) │ 109.2ms (0.61x) │  61.8ms (0.34x) │
│ 37    │                   111.7ms │    44.4ms (0.40x) │  97.0ms (0.87x) │  50.6ms (0.45x) │
│ 38    │                   167.0ms │    49.6ms (0.30x) │  95.6ms (0.57x) │  55.4ms (0.33x) │
│ 39    │                   301.0ms │   119.7ms (0.40x) │ 182.3ms (0.61x) │ 116.9ms (0.39x) │
│ 40    │                    65.7ms │    21.6ms (0.33x) │  41.0ms (0.62x) │  28.6ms (0.44x) │
│ 41    │                    62.0ms │    19.5ms (0.32x) │  40.0ms (0.64x) │  26.9ms (0.43x) │
│ 42    │                    32.3ms │    14.7ms (0.46x) │  29.2ms (0.90x) │  22.8ms (0.71x) │
└───────┴───────────────────────────┴───────────────────┴─────────────────┴─────────────────┘

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done adef771 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 8fd803e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench Sorted on NVME (base) failed! Check the workflow run for details.

@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling (base)

Vortex (geomean): 1.033x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.033x ➖, 0↑ 1↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116440656 122658008 0.95
polarsignals_q01/datafusion:vortex-file-compressed 272059190 268349872 1.01
polarsignals_q02/datafusion:vortex-file-compressed 22172496 22363196 0.99
polarsignals_q03/datafusion:vortex-file-compressed 279839627 264918414 1.06
polarsignals_q04/datafusion:vortex-file-compressed 9698291 9212323 1.05
polarsignals_q05/datafusion:vortex-file-compressed 12717663 12591197 1.01
polarsignals_q06/datafusion:vortex-file-compressed 20633716 20649359 1.00
polarsignals_q07/datafusion:vortex-file-compressed 🚨 11729809 10195861 1.15
polarsignals_q08/datafusion:vortex-file-compressed 419385725 382652655 1.10
polarsignals_q09/datafusion:vortex-file-compressed 11272876 11029323 1.02

No file size changes detected.

@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+4.2%, environment too noisy confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53876868 54911226 0.98
tpch_q02/datafusion:vortex-file-compressed 22480483 22641993 0.99
tpch_q03/datafusion:vortex-file-compressed 30658313 29782042 1.03
tpch_q04/datafusion:vortex-file-compressed 19331664 19896542 0.97
tpch_q05/datafusion:vortex-file-compressed 45759361 45532961 1.00
tpch_q06/datafusion:vortex-file-compressed 9971478 9812608 1.02
tpch_q07/datafusion:vortex-file-compressed 53421402 51131791 1.04
tpch_q08/datafusion:vortex-file-compressed 39962189 38254423 1.04
tpch_q09/datafusion:vortex-file-compressed 52046977 51902997 1.00
tpch_q10/datafusion:vortex-file-compressed 32512972 32350022 1.01
tpch_q11/datafusion:vortex-file-compressed 16567978 16435947 1.01
tpch_q12/datafusion:vortex-file-compressed 23692342 23356959 1.01
tpch_q13/datafusion:vortex-file-compressed 26458055 26587455 1.00
tpch_q14/datafusion:vortex-file-compressed 14686820 15075815 0.97
tpch_q15/datafusion:vortex-file-compressed 22230381 22020989 1.01
tpch_q16/datafusion:vortex-file-compressed 19282057 19684588 0.98
tpch_q17/datafusion:vortex-file-compressed 64774748 66414075 0.98
tpch_q18/datafusion:vortex-file-compressed 74846558 77470542 0.97
tpch_q19/datafusion:vortex-file-compressed 31703311 29959684 1.06
tpch_q20/datafusion:vortex-file-compressed 30060551 29882649 1.01
tpch_q21/datafusion:vortex-file-compressed 67704082 70326633 0.96
tpch_q22/datafusion:vortex-file-compressed 11904024 11768685 1.01
datafusion / parquet (1.003x ➖, 1↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 135009988 141080833 0.96
tpch_q02/datafusion:parquet 60835068 59769369 1.02
tpch_q03/datafusion:parquet 83027613 80967016 1.03
tpch_q04/datafusion:parquet 47157017 46393347 1.02
tpch_q05/datafusion:parquet 89434735 93960226 0.95
tpch_q06/datafusion:parquet 41159612 40290403 1.02
tpch_q07/datafusion:parquet 104988750 101344371 1.04
tpch_q08/datafusion:parquet 97286390 93936005 1.04
tpch_q09/datafusion:parquet 121275277 122034603 0.99
tpch_q10/datafusion:parquet 118256286 111837654 1.06
tpch_q11/datafusion:parquet 41552952 39717836 1.05
tpch_q12/datafusion:parquet 82923847 84842131 0.98
tpch_q13/datafusion:parquet 196310359 190467464 1.03
tpch_q14/datafusion:parquet 39449769 41014034 0.96
tpch_q15/datafusion:parquet 63224421 58650133 1.08
tpch_q16/datafusion:parquet 42430592 42317547 1.00
tpch_q17/datafusion:parquet 142383574 139823921 1.02
tpch_q18/datafusion:parquet 154318933 153652407 1.00
tpch_q19/datafusion:parquet 🚀 65433448 76844937 0.85
tpch_q20/datafusion:parquet 71519192 71126430 1.01
tpch_q21/datafusion:parquet 137441643 140448292 0.98
tpch_q22/datafusion:parquet 43523809 42706599 1.02
datafusion / arrow (1.018x ➖, 0↑ 2↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 61536418 63923378 0.96
tpch_q02/datafusion:arrow 16799869 17101129 0.98
tpch_q03/datafusion:arrow 31956676 31179135 1.02
tpch_q04/datafusion:arrow 26471725 25625045 1.03
tpch_q05/datafusion:arrow 58066201 53941591 1.08
tpch_q06/datafusion:arrow 🚨 23609706 20714284 1.14
tpch_q07/datafusion:arrow 105930666 103293822 1.03
tpch_q08/datafusion:arrow 42611650 42320179 1.01
tpch_q09/datafusion:arrow 61870010 65381922 0.95
tpch_q10/datafusion:arrow 47507227 52294609 0.91
tpch_q11/datafusion:arrow 9144652 8989946 1.02
tpch_q12/datafusion:arrow 48453267 47603220 1.02
tpch_q13/datafusion:arrow 45598478 46595020 0.98
tpch_q14/datafusion:arrow 23627134 22793378 1.04
tpch_q15/datafusion:arrow 46203530 43682252 1.06
tpch_q16/datafusion:arrow 16224449 16128083 1.01
tpch_q17/datafusion:arrow 67258458 65320783 1.03
tpch_q18/datafusion:arrow 108901324 106221181 1.03
tpch_q19/datafusion:arrow 🚨 41800480 35960061 1.16
tpch_q20/datafusion:arrow 35324898 36849069 0.96
tpch_q21/datafusion:arrow 157356398 148686677 1.06
tpch_q22/datafusion:arrow 12203591 12400732 0.98
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31372880 31198814 1.01
tpch_q02/duckdb:vortex-file-compressed 25654337 25913682 0.99
tpch_q03/duckdb:vortex-file-compressed 32603264 33207111 0.98
tpch_q04/duckdb:vortex-file-compressed 28566014 29985099 0.95
tpch_q05/duckdb:vortex-file-compressed 37683289 39863419 0.95
tpch_q06/duckdb:vortex-file-compressed 7800700 8031052 0.97
tpch_q07/duckdb:vortex-file-compressed 35646568 35900090 0.99
tpch_q08/duckdb:vortex-file-compressed 41934592 40694828 1.03
tpch_q09/duckdb:vortex-file-compressed 60317683 59643337 1.01
tpch_q10/duckdb:vortex-file-compressed 41872628 42392925 0.99
tpch_q11/duckdb:vortex-file-compressed 14968520 15403152 0.97
tpch_q12/duckdb:vortex-file-compressed 22918979 22708324 1.01
tpch_q13/duckdb:vortex-file-compressed 40407396 41914200 0.96
tpch_q14/duckdb:vortex-file-compressed 21835194 22035521 0.99
tpch_q15/duckdb:vortex-file-compressed 16722624 16809798 0.99
tpch_q16/duckdb:vortex-file-compressed 29774019 30518318 0.98
tpch_q17/duckdb:vortex-file-compressed 22941085 23652127 0.97
tpch_q18/duckdb:vortex-file-compressed 54217362 54291455 1.00
tpch_q19/duckdb:vortex-file-compressed 28558908 28676749 1.00
tpch_q20/duckdb:vortex-file-compressed 32782091 33621326 0.98
tpch_q21/duckdb:vortex-file-compressed 99919424 102326073 0.98
tpch_q22/duckdb:vortex-file-compressed 17861977 17044906 1.05
duckdb / parquet (0.948x ➖, 6↑ 1↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77201015 76563304 1.01
tpch_q02/duckdb:parquet 39313720 39275306 1.00
tpch_q03/duckdb:parquet 70194516 70986889 0.99
tpch_q04/duckdb:parquet 49508991 49480687 1.00
tpch_q05/duckdb:parquet 67955068 68426549 0.99
tpch_q06/duckdb:parquet 23386240 22459315 1.04
tpch_q07/duckdb:parquet 🚀 69281586 83548469 0.83
tpch_q08/duckdb:parquet 🚀 83824292 99830126 0.84
tpch_q09/duckdb:parquet 🚀 133569530 171639015 0.78
tpch_q10/duckdb:parquet 🚀 125862043 140329631 0.90
tpch_q11/duckdb:parquet 22222711 24682673 0.90
tpch_q12/duckdb:parquet 🚨 59114062 50104486 1.18
tpch_q13/duckdb:parquet 🚀 252578870 281876836 0.90
tpch_q14/duckdb:parquet 🚀 50682825 60233141 0.84
tpch_q15/duckdb:parquet 25949500 27476460 0.94
tpch_q16/duckdb:parquet 57014948 61104408 0.93
tpch_q17/duckdb:parquet 55444735 59563957 0.93
tpch_q18/duckdb:parquet 118281033 120384252 0.98
tpch_q19/duckdb:parquet 69226815 71030028 0.97
tpch_q20/duckdb:parquet 65635924 65682626 1.00
tpch_q21/duckdb:parquet 175132847 174175526 1.01
tpch_q22/duckdb:parquet 53653739 54727396 0.98
File Size Changes (17 files changed, -44.6% overall, 4↑ 13↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-file-compressed 4.93 MB 4.97 MB +42.60 KB +0.8%
lineitem_1.vortex 1.0 vortex-file-compressed 81.92 MB 82.01 MB +89.34 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.89 MB +8.38 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.70 MB +13.49 KB +0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 82.26 MB 82.17 MB 89.93 KB -0.1%
supplier_0.vortex 1.0 vortex-file-compressed 609.91 KB 603.76 KB 6.15 KB -1.0%
orders_0.vortex 1.0 vortex-file-compressed 35.54 MB 34.84 MB 721.62 KB -2.0%
customer_0.vortex 1.0 vortex-compact 7.43 MB 0 B 7.43 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 1.0 vortex-compact 63.00 MB 0 B 63.00 MB -100.0%
lineitem_1.vortex 1.0 vortex-compact 63.03 MB 0 B 63.03 MB -100.0%
nation_0.vortex 1.0 vortex-compact 8.18 KB 0 B 8.18 KB -100.0%
orders_0.vortex 1.0 vortex-compact 32.20 MB 0 B 32.20 MB -100.0%
part_0.vortex 1.0 vortex-compact 3.44 MB 0 B 3.44 MB -100.0%
partsupp_0.vortex 1.0 vortex-compact 20.76 MB 0 B 20.76 MB -100.0%
region_0.vortex 1.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 1.0 vortex-compact 496.46 KB 0 B 496.46 KB -100.0%

Totals:

  • vortex-compact: 190.63 MB → 0 B (-100.0%)
  • vortex-file-compressed: 238.11 MB → 237.46 MB (-0.3%)

@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.995x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5015177 5008081 1.00
fineweb_q01/datafusion:vortex-file-compressed 34407641 34229815 1.01
fineweb_q02/datafusion:vortex-file-compressed 38781375 39520841 0.98
fineweb_q03/datafusion:vortex-file-compressed 57738724 56194140 1.03
fineweb_q04/datafusion:vortex-file-compressed 275604650 275251945 1.00
fineweb_q05/datafusion:vortex-file-compressed 225633621 222251411 1.02
fineweb_q06/datafusion:vortex-file-compressed 50089231 50619055 0.99
fineweb_q07/datafusion:vortex-file-compressed 56833243 57937397 0.98
fineweb_q08/datafusion:vortex-file-compressed 22489856 23539980 0.96
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6951876 7578340 0.92
fineweb_q01/datafusion:parquet 285329418 289796271 0.98
fineweb_q02/datafusion:parquet 294688446 297748904 0.99
fineweb_q03/datafusion:parquet 299006197 280924587 1.06
fineweb_q04/datafusion:parquet 305310001 296583291 1.03
fineweb_q05/datafusion:parquet 293441419 308992077 0.95
fineweb_q06/datafusion:parquet 285068372 293742940 0.97
fineweb_q07/datafusion:parquet 280195137 280895236 1.00
fineweb_q08/datafusion:parquet 282178378 275259447 1.03
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3411038 3544533 0.96
fineweb_q01/duckdb:vortex-file-compressed 33217901 33610160 0.99
fineweb_q02/duckdb:vortex-file-compressed 40566331 39369500 1.03
fineweb_q03/duckdb:vortex-file-compressed 118114754 110148860 1.07
fineweb_q04/duckdb:vortex-file-compressed 276237332 275975934 1.00
fineweb_q05/duckdb:vortex-file-compressed 212654997 216404436 0.98
fineweb_q06/duckdb:vortex-file-compressed 51750650 50825268 1.02
fineweb_q07/duckdb:vortex-file-compressed 54271096 53962241 1.01
fineweb_q08/duckdb:vortex-file-compressed 20655493 21070232 0.98
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32520653 31447586 1.03
fineweb_q01/duckdb:parquet 83171444 83950254 0.99
fineweb_q02/duckdb:parquet 85972849 84778721 1.01
fineweb_q03/duckdb:parquet 315257758 315357647 1.00
fineweb_q04/duckdb:parquet 446289585 448105211 1.00
fineweb_q05/duckdb:parquet 413468845 413802475 1.00
fineweb_q06/duckdb:parquet 203969082 202947529 1.01
fineweb_q07/duckdb:parquet 216481835 215353602 1.01
fineweb_q08/duckdb:parquet 32937977 31949869 1.03
File Size Changes (3 files changed, -46.3% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 1.02 MB -0.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.1%)

@github-actions

github-actions Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-2.7%, low confidence)
Vortex (geomean): 0.928x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish -7.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.922x ➖, 27↑ 1↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24617247 27065875 0.91
tpcds_q02/datafusion:vortex-file-compressed 🚀 47251397 53122299 0.89
tpcds_q03/datafusion:vortex-file-compressed 15891745 17374438 0.91
tpcds_q04/datafusion:vortex-file-compressed 🚀 241050555 275774548 0.87
tpcds_q05/datafusion:vortex-file-compressed 46008064 48154275 0.96
tpcds_q06/datafusion:vortex-file-compressed 22959851 24438827 0.94
tpcds_q07/datafusion:vortex-file-compressed 42874777 44394565 0.97
tpcds_q08/datafusion:vortex-file-compressed 30508927 31618903 0.96
tpcds_q09/datafusion:vortex-file-compressed 30462784 31972937 0.95
tpcds_q10/datafusion:vortex-file-compressed 🚀 38061148 42948797 0.89
tpcds_q11/datafusion:vortex-file-compressed 131041576 140530779 0.93
tpcds_q12/datafusion:vortex-file-compressed 19806512 19522974 1.01
tpcds_q13/datafusion:vortex-file-compressed 46926938 50185651 0.94
tpcds_q14/datafusion:vortex-file-compressed 162312134 165793687 0.98
tpcds_q15/datafusion:vortex-file-compressed 🚀 25901208 28863675 0.90
tpcds_q16/datafusion:vortex-file-compressed 🚀 24964044 28004477 0.89
tpcds_q17/datafusion:vortex-file-compressed 62081493 68789546 0.90
tpcds_q18/datafusion:vortex-file-compressed 62663198 68604672 0.91
tpcds_q19/datafusion:vortex-file-compressed 🚀 21271376 25945266 0.82
tpcds_q20/datafusion:vortex-file-compressed 21323556 22934950 0.93
tpcds_q21/datafusion:vortex-file-compressed 🚀 36082781 40301564 0.90
tpcds_q22/datafusion:vortex-file-compressed 🚀 123311033 157422339 0.78
tpcds_q23/datafusion:vortex-file-compressed 150027702 161549874 0.93
tpcds_q24/datafusion:vortex-file-compressed 🚀 83269154 94169034 0.88
tpcds_q25/datafusion:vortex-file-compressed 65095520 69331432 0.94
tpcds_q26/datafusion:vortex-file-compressed 33882971 35515524 0.95
tpcds_q27/datafusion:vortex-file-compressed 🚀 89312740 100152715 0.89
tpcds_q28/datafusion:vortex-file-compressed 29111152 30391434 0.96
tpcds_q29/datafusion:vortex-file-compressed 62495319 63986732 0.98
tpcds_q30/datafusion:vortex-file-compressed 🚀 23347003 26393655 0.88
tpcds_q31/datafusion:vortex-file-compressed 🚀 71749824 81880932 0.88
tpcds_q32/datafusion:vortex-file-compressed 19078851 20505635 0.93
tpcds_q33/datafusion:vortex-file-compressed 28433884 31217220 0.91
tpcds_q34/datafusion:vortex-file-compressed 25724784 27524858 0.93
tpcds_q35/datafusion:vortex-file-compressed 45049673 48549148 0.93
tpcds_q36/datafusion:vortex-file-compressed 🚀 56659653 63935963 0.89
tpcds_q37/datafusion:vortex-file-compressed 20273659 21554627 0.94
tpcds_q38/datafusion:vortex-file-compressed 42813877 47456190 0.90
tpcds_q39/datafusion:vortex-file-compressed 108990053 114248777 0.95
tpcds_q40/datafusion:vortex-file-compressed 31552433 33548808 0.94
tpcds_q41/datafusion:vortex-file-compressed 20253273 22401776 0.90
tpcds_q42/datafusion:vortex-file-compressed 13514802 15015854 0.90
tpcds_q43/datafusion:vortex-file-compressed 17985662 19537669 0.92
tpcds_q44/datafusion:vortex-file-compressed 🚀 29597624 34293102 0.86
tpcds_q45/datafusion:vortex-file-compressed 30897856 29003505 1.07
tpcds_q46/datafusion:vortex-file-compressed 🚀 35076846 39192789 0.89
tpcds_q47/datafusion:vortex-file-compressed 134268736 145393318 0.92
tpcds_q48/datafusion:vortex-file-compressed 35196456 36823869 0.96
tpcds_q49/datafusion:vortex-file-compressed 57270157 61955815 0.92
tpcds_q50/datafusion:vortex-file-compressed 38692432 40892267 0.95
tpcds_q51/datafusion:vortex-file-compressed 90888388 96654899 0.94
tpcds_q52/datafusion:vortex-file-compressed 🚀 13891122 15473549 0.90
tpcds_q53/datafusion:vortex-file-compressed 23245371 23858641 0.97
tpcds_q54/datafusion:vortex-file-compressed 33961865 36556880 0.93
tpcds_q55/datafusion:vortex-file-compressed 🚀 13236109 14816553 0.89
tpcds_q56/datafusion:vortex-file-compressed 30872244 32424224 0.95
tpcds_q57/datafusion:vortex-file-compressed 107940025 113959219 0.95
tpcds_q58/datafusion:vortex-file-compressed 54751698 59672356 0.92
tpcds_q59/datafusion:vortex-file-compressed 58170060 59291854 0.98
tpcds_q60/datafusion:vortex-file-compressed 29802779 30719702 0.97
tpcds_q61/datafusion:vortex-file-compressed 40382338 42826277 0.94
tpcds_q62/datafusion:vortex-file-compressed 🚀 21129267 25265898 0.84
tpcds_q63/datafusion:vortex-file-compressed 22319217 23561105 0.95
tpcds_q64/datafusion:vortex-file-compressed 🚀 381421789 426958403 0.89
tpcds_q65/datafusion:vortex-file-compressed 49504644 54433154 0.91
tpcds_q66/datafusion:vortex-file-compressed 74124057 79060071 0.94
tpcds_q67/datafusion:vortex-file-compressed 151073232 163909959 0.92
tpcds_q68/datafusion:vortex-file-compressed 33360680 34966933 0.95
tpcds_q69/datafusion:vortex-file-compressed 🚀 36088293 40186924 0.90
tpcds_q70/datafusion:vortex-file-compressed 93156771 100563705 0.93
tpcds_q71/datafusion:vortex-file-compressed 23544486 24977306 0.94
tpcds_q72/datafusion:vortex-file-compressed 2108717580 2310630645 0.91
tpcds_q73/datafusion:vortex-file-compressed 24583700 26137604 0.94
tpcds_q74/datafusion:vortex-file-compressed 78578860 84010592 0.94
tpcds_q75/datafusion:vortex-file-compressed 111168532 119507378 0.93
tpcds_q76/datafusion:vortex-file-compressed 27216821 28774869 0.95
tpcds_q77/datafusion:vortex-file-compressed 36573236 40116094 0.91
tpcds_q78/datafusion:vortex-file-compressed 116773013 129435005 0.90
tpcds_q79/datafusion:vortex-file-compressed 28858181 31100766 0.93
tpcds_q80/datafusion:vortex-file-compressed 🚀 87102178 97136308 0.90
tpcds_q81/datafusion:vortex-file-compressed 🚀 25337103 28381338 0.89
tpcds_q82/datafusion:vortex-file-compressed 21577535 23183408 0.93
tpcds_q83/datafusion:vortex-file-compressed 36559351 39418975 0.93
tpcds_q84/datafusion:vortex-file-compressed 12708499 13800451 0.92
tpcds_q85/datafusion:vortex-file-compressed 93002716 99149248 0.94
tpcds_q86/datafusion:vortex-file-compressed 🚀 17428534 19626778 0.89
tpcds_q87/datafusion:vortex-file-compressed 43050977 46668502 0.92
tpcds_q88/datafusion:vortex-file-compressed 53713368 57818093 0.93
tpcds_q89/datafusion:vortex-file-compressed 24954444 27062340 0.92
tpcds_q90/datafusion:vortex-file-compressed 🚀 13603660 15118607 0.90
tpcds_q91/datafusion:vortex-file-compressed 🚀 18282414 20442974 0.89
tpcds_q92/datafusion:vortex-file-compressed 🚀 17665833 22803519 0.77
tpcds_q93/datafusion:vortex-file-compressed 31939712 35164567 0.91
tpcds_q94/datafusion:vortex-file-compressed 22260682 24689002 0.90
tpcds_q95/datafusion:vortex-file-compressed 58157390 61384586 0.95
tpcds_q96/datafusion:vortex-file-compressed 13274095 13500151 0.98
tpcds_q97/datafusion:vortex-file-compressed 29605987 31349042 0.94
tpcds_q98/datafusion:vortex-file-compressed 🚀 23710164 27000360 0.88
tpcds_q99/datafusion:vortex-file-compressed 🚨 31699298 28476414 1.11
datafusion / parquet (0.926x ➖, 23↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23584563 26100659 0.90
tpcds_q02/datafusion:parquet 41410490 44745944 0.93
tpcds_q03/datafusion:parquet 13092841 14434412 0.91
tpcds_q04/datafusion:parquet 🚀 294414400 345318282 0.85
tpcds_q05/datafusion:parquet 45493144 49969584 0.91
tpcds_q06/datafusion:parquet 23319696 25629807 0.91
tpcds_q07/datafusion:parquet 76623927 83986049 0.91
tpcds_q08/datafusion:parquet 30176981 30919543 0.98
tpcds_q09/datafusion:parquet 40413620 41435823 0.98
tpcds_q10/datafusion:parquet 76870946 79503099 0.97
tpcds_q11/datafusion:parquet 151464228 154780462 0.98
tpcds_q12/datafusion:parquet 17201077 18145183 0.95
tpcds_q13/datafusion:parquet 74831090 78454521 0.95
tpcds_q14/datafusion:parquet 159626195 167842630 0.95
tpcds_q15/datafusion:parquet 20341442 22466041 0.91
tpcds_q16/datafusion:parquet 29047957 29804214 0.97
tpcds_q17/datafusion:parquet 🚀 60464216 68427865 0.88
tpcds_q18/datafusion:parquet 108375052 110594243 0.98
tpcds_q19/datafusion:parquet 22344453 24388984 0.92
tpcds_q20/datafusion:parquet 17469176 18642140 0.94
tpcds_q21/datafusion:parquet 18619440 20159067 0.92
tpcds_q22/datafusion:parquet 165768370 166117898 1.00
tpcds_q23/datafusion:parquet 🚀 146282751 164828290 0.89
tpcds_q24/datafusion:parquet 90351064 94173939 0.96
tpcds_q25/datafusion:parquet 63902879 68367744 0.93
tpcds_q26/datafusion:parquet 67135261 71124920 0.94
tpcds_q27/datafusion:parquet 136797511 149028275 0.92
tpcds_q28/datafusion:parquet 43931518 45890790 0.96
tpcds_q29/datafusion:parquet 62004648 66975594 0.93
tpcds_q30/datafusion:parquet 33327853 36502091 0.91
tpcds_q31/datafusion:parquet 🚀 64032127 72106109 0.89
tpcds_q32/datafusion:parquet 16275913 17807432 0.91
tpcds_q33/datafusion:parquet 27321080 28728756 0.95
tpcds_q34/datafusion:parquet 🚀 21759116 24888466 0.87
tpcds_q35/datafusion:parquet 69385346 77042575 0.90
tpcds_q36/datafusion:parquet 🚀 57297650 63670001 0.90
tpcds_q37/datafusion:parquet 🚀 18473982 21367793 0.86
tpcds_q38/datafusion:parquet 41075856 43225555 0.95
tpcds_q39/datafusion:parquet 🚀 72502715 84789196 0.86
tpcds_q40/datafusion:parquet 🚀 21807710 25126584 0.87
tpcds_q41/datafusion:parquet 🚀 14373392 16222036 0.89
tpcds_q42/datafusion:parquet 11845843 12714090 0.93
tpcds_q43/datafusion:parquet 🚀 16500670 18594286 0.89
tpcds_q44/datafusion:parquet 33896975 35800354 0.95
tpcds_q45/datafusion:parquet 🚀 27242626 30938327 0.88
tpcds_q46/datafusion:parquet 31720319 34451859 0.92
tpcds_q47/datafusion:parquet 128177241 139604705 0.92
tpcds_q48/datafusion:parquet 🚀 69137121 76988757 0.90
tpcds_q49/datafusion:parquet 57402990 58755491 0.98
tpcds_q50/datafusion:parquet 41668833 45657349 0.91
tpcds_q51/datafusion:parquet 87390382 94470828 0.93
tpcds_q52/datafusion:parquet 🚀 11937852 13902582 0.86
tpcds_q53/datafusion:parquet 17811672 18971373 0.94
tpcds_q54/datafusion:parquet 33746415 35350425 0.95
tpcds_q55/datafusion:parquet 🚀 11455854 12897666 0.89
tpcds_q56/datafusion:parquet 27980247 29643400 0.94
tpcds_q57/datafusion:parquet 97246558 101194995 0.96
tpcds_q58/datafusion:parquet 54679400 58876922 0.93
tpcds_q59/datafusion:parquet 62219928 64854242 0.96
tpcds_q60/datafusion:parquet 27544042 30064689 0.92
tpcds_q61/datafusion:parquet 43031669 44144711 0.97
tpcds_q62/datafusion:parquet 24494671 26778122 0.91
tpcds_q63/datafusion:parquet 17873871 19353917 0.92
tpcds_q64/datafusion:parquet 293963479 322727323 0.91
tpcds_q65/datafusion:parquet 🚀 36241368 41179079 0.88
tpcds_q66/datafusion:parquet 68707454 73983303 0.93
tpcds_q67/datafusion:parquet 145584960 149371577 0.97
tpcds_q68/datafusion:parquet 🚀 30431867 33993270 0.90
tpcds_q69/datafusion:parquet 70833333 70763447 1.00
tpcds_q70/datafusion:parquet 34820829 34556132 1.01
tpcds_q71/datafusion:parquet 22720467 24588703 0.92
tpcds_q72/datafusion:parquet 577081222 625754514 0.92
tpcds_q73/datafusion:parquet 🚀 21101178 23793186 0.89
tpcds_q74/datafusion:parquet 83003637 89478321 0.93
tpcds_q75/datafusion:parquet 104214432 112918372 0.92
tpcds_q76/datafusion:parquet 30311503 32852932 0.92
tpcds_q77/datafusion:parquet 🚀 37937996 42753449 0.89
tpcds_q78/datafusion:parquet 110356677 120777760 0.91
tpcds_q79/datafusion:parquet 🚀 25900063 29063311 0.89
tpcds_q80/datafusion:parquet 74494796 82048305 0.91
tpcds_q81/datafusion:parquet 29706389 31205031 0.95
tpcds_q82/datafusion:parquet 19484999 19745980 0.99
tpcds_q83/datafusion:parquet 41221377 43659558 0.94
tpcds_q84/datafusion:parquet 39854685 42546980 0.94
tpcds_q85/datafusion:parquet 149040583 157655294 0.95
tpcds_q86/datafusion:parquet 15619540 15092798 1.03
tpcds_q87/datafusion:parquet 🚀 42644984 49531239 0.86
tpcds_q88/datafusion:parquet 62067600 61857196 1.00
tpcds_q89/datafusion:parquet 23225712 23615475 0.98
tpcds_q90/datafusion:parquet 14627058 16222639 0.90
tpcds_q91/datafusion:parquet 57265351 62156037 0.92
tpcds_q92/datafusion:parquet 17144301 18777378 0.91
tpcds_q93/datafusion:parquet 🚀 29412684 33313229 0.88
tpcds_q94/datafusion:parquet 21096110 23174694 0.91
tpcds_q95/datafusion:parquet 58601420 63709086 0.92
tpcds_q96/datafusion:parquet 12060707 12852149 0.94
tpcds_q97/datafusion:parquet 28996742 31661146 0.92
tpcds_q98/datafusion:parquet 21463553 22665022 0.95
tpcds_q99/datafusion:parquet 🚀 26453590 29522962 0.90
duckdb / vortex-file-compressed (0.934x ➖, 17↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24090782 26710405 0.90
tpcds_q02/duckdb:vortex-file-compressed 37182450 34014011 1.09
tpcds_q03/duckdb:vortex-file-compressed 🚀 15236995 17009444 0.90
tpcds_q04/duckdb:vortex-file-compressed 97574946 100669672 0.97
tpcds_q05/duckdb:vortex-file-compressed 35841712 37094208 0.97
tpcds_q06/duckdb:vortex-file-compressed 33070898 36131631 0.92
tpcds_q07/duckdb:vortex-file-compressed 25048169 25957379 0.96
tpcds_q08/duckdb:vortex-file-compressed 🚀 27821529 31282644 0.89
tpcds_q09/duckdb:vortex-file-compressed 17510394 17377201 1.01
tpcds_q10/duckdb:vortex-file-compressed 38110691 41950446 0.91
tpcds_q11/duckdb:vortex-file-compressed 65374907 69688182 0.94
tpcds_q12/duckdb:vortex-file-compressed 🚀 15885977 17843780 0.89
tpcds_q13/duckdb:vortex-file-compressed 32155561 33979718 0.95
tpcds_q14/duckdb:vortex-file-compressed 96313995 102992473 0.94
tpcds_q15/duckdb:vortex-file-compressed 26848082 28140352 0.95
tpcds_q16/duckdb:vortex-file-compressed 25819933 26988531 0.96
tpcds_q17/duckdb:vortex-file-compressed 48631688 51199862 0.95
tpcds_q18/duckdb:vortex-file-compressed 38562069 42026978 0.92
tpcds_q19/duckdb:vortex-file-compressed 33631996 34378068 0.98
tpcds_q20/duckdb:vortex-file-compressed 🚀 16362970 18306197 0.89
tpcds_q21/duckdb:vortex-file-compressed 🚀 15817556 18009509 0.88
tpcds_q22/duckdb:vortex-file-compressed 🚀 73976193 87265152 0.85
tpcds_q23/duckdb:vortex-file-compressed 92449384 100124079 0.92
tpcds_q24/duckdb:vortex-file-compressed 🚀 48663524 55148169 0.88
tpcds_q25/duckdb:vortex-file-compressed 41512671 43263026 0.96
tpcds_q26/duckdb:vortex-file-compressed 20483216 21596990 0.95
tpcds_q27/duckdb:vortex-file-compressed 26854312 28159849 0.95
tpcds_q28/duckdb:vortex-file-compressed 12393002 13123439 0.94
tpcds_q29/duckdb:vortex-file-compressed 44019254 48096720 0.92
tpcds_q30/duckdb:vortex-file-compressed 25387190 26404490 0.96
tpcds_q31/duckdb:vortex-file-compressed 29772952 29264454 1.02
tpcds_q32/duckdb:vortex-file-compressed 🚀 12991787 15207696 0.85
tpcds_q33/duckdb:vortex-file-compressed 🚀 24354785 27307740 0.89
tpcds_q34/duckdb:vortex-file-compressed 25749303 27336228 0.94
tpcds_q35/duckdb:vortex-file-compressed 65809704 68791900 0.96
tpcds_q36/duckdb:vortex-file-compressed 25473320 26351967 0.97
tpcds_q37/duckdb:vortex-file-compressed 19550613 21634833 0.90
tpcds_q38/duckdb:vortex-file-compressed 36551546 40334187 0.91
tpcds_q39/duckdb:vortex-file-compressed 36209854 36352404 1.00
tpcds_q40/duckdb:vortex-file-compressed 🚀 19960961 23078635 0.86
tpcds_q41/duckdb:vortex-file-compressed 12220078 13037095 0.94
tpcds_q42/duckdb:vortex-file-compressed 13306992 14034805 0.95
tpcds_q43/duckdb:vortex-file-compressed 22268503 22701628 0.98
tpcds_q44/duckdb:vortex-file-compressed 22012432 23599854 0.93
tpcds_q45/duckdb:vortex-file-compressed 30939197 32990120 0.94
tpcds_q46/duckdb:vortex-file-compressed 32809434 32565112 1.01
tpcds_q47/duckdb:vortex-file-compressed 52503840 55220768 0.95
tpcds_q48/duckdb:vortex-file-compressed 28797083 30615305 0.94
tpcds_q49/duckdb:vortex-file-compressed 35221209 38383317 0.92
tpcds_q50/duckdb:vortex-file-compressed 26680543 29596474 0.90
tpcds_q51/duckdb:vortex-file-compressed 105276174 108278516 0.97
tpcds_q52/duckdb:vortex-file-compressed 13263356 13884847 0.96
tpcds_q53/duckdb:vortex-file-compressed 23166526 24058610 0.96
tpcds_q54/duckdb:vortex-file-compressed 29336920 31709904 0.93
tpcds_q55/duckdb:vortex-file-compressed 12375893 13190053 0.94
tpcds_q56/duckdb:vortex-file-compressed 26445113 29029567 0.91
tpcds_q57/duckdb:vortex-file-compressed 41192002 44569864 0.92
tpcds_q58/duckdb:vortex-file-compressed 🚀 28750955 32109983 0.90
tpcds_q59/duckdb:vortex-file-compressed 56666300 58701241 0.97
tpcds_q60/duckdb:vortex-file-compressed 27927818 28575356 0.98
tpcds_q61/duckdb:vortex-file-compressed 31187000 31969600 0.98
tpcds_q62/duckdb:vortex-file-compressed 🚀 15154871 17771483 0.85
tpcds_q63/duckdb:vortex-file-compressed 21052383 22699187 0.93
tpcds_q64/duckdb:vortex-file-compressed 96441810 100128114 0.96
tpcds_q65/duckdb:vortex-file-compressed 22228813 23387471 0.95
tpcds_q66/duckdb:vortex-file-compressed 29413976 31163087 0.94
tpcds_q67/duckdb:vortex-file-compressed 142081105 152540110 0.93
tpcds_q68/duckdb:vortex-file-compressed 31504054 32807213 0.96
tpcds_q69/duckdb:vortex-file-compressed 40211374 43572719 0.92
tpcds_q70/duckdb:vortex-file-compressed 39325213 41452164 0.95
tpcds_q71/duckdb:vortex-file-compressed 20799188 22788922 0.91
tpcds_q72/duckdb:vortex-file-compressed 175388406 183199584 0.96
tpcds_q73/duckdb:vortex-file-compressed 24434461 26386652 0.93
tpcds_q74/duckdb:vortex-file-compressed 41748439 45129557 0.93
tpcds_q75/duckdb:vortex-file-compressed 49593262 52995508 0.94
tpcds_q76/duckdb:vortex-file-compressed 21947130 23055950 0.95
tpcds_q77/duckdb:vortex-file-compressed 🚀 24470090 27640693 0.89
tpcds_q78/duckdb:vortex-file-compressed 80560867 80967110 0.99
tpcds_q79/duckdb:vortex-file-compressed 🚀 24151148 27636991 0.87
tpcds_q80/duckdb:vortex-file-compressed 51130946 52178015 0.98
tpcds_q81/duckdb:vortex-file-compressed 🚀 29198032 33130461 0.88
tpcds_q82/duckdb:vortex-file-compressed 45679135 48784306 0.94
tpcds_q83/duckdb:vortex-file-compressed 30676998 33338524 0.92
tpcds_q84/duckdb:vortex-file-compressed 16725741 17583465 0.95
tpcds_q85/duckdb:vortex-file-compressed 44432066 47868063 0.93
tpcds_q86/duckdb:vortex-file-compressed 17474209 18593414 0.94
tpcds_q87/duckdb:vortex-file-compressed 40722676 44260420 0.92
tpcds_q88/duckdb:vortex-file-compressed 53111852 58202341 0.91
tpcds_q89/duckdb:vortex-file-compressed 22110017 24456337 0.90
tpcds_q90/duckdb:vortex-file-compressed 11530008 12463154 0.93
tpcds_q91/duckdb:vortex-file-compressed 23888651 25122942 0.95
tpcds_q92/duckdb:vortex-file-compressed 18951518 19377783 0.98
tpcds_q93/duckdb:vortex-file-compressed 30742178 31505723 0.98
tpcds_q94/duckdb:vortex-file-compressed 🚀 22588819 25341919 0.89
tpcds_q95/duckdb:vortex-file-compressed 156923083 163129449 0.96
tpcds_q96/duckdb:vortex-file-compressed 🚀 11904640 14401849 0.83
tpcds_q97/duckdb:vortex-file-compressed 38545904 42470780 0.91
tpcds_q98/duckdb:vortex-file-compressed 19726408 21017838 0.94
tpcds_q99/duckdb:vortex-file-compressed 22058261 24201461 0.91
duckdb / parquet (0.960x ➖, 2↑ 1↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28899888 31270907 0.92
tpcds_q02/duckdb:parquet 24766433 24941813 0.99
tpcds_q03/duckdb:parquet 12674137 13162835 0.96
tpcds_q04/duckdb:parquet 170350307 176708363 0.96
tpcds_q05/duckdb:parquet 31396335 32940684 0.95
tpcds_q06/duckdb:parquet 33710848 35586840 0.95
tpcds_q07/duckdb:parquet 24133897 24993184 0.97
tpcds_q08/duckdb:parquet 29361792 29879670 0.98
tpcds_q09/duckdb:parquet 44001602 45831157 0.96
tpcds_q10/duckdb:parquet 37732628 39906119 0.95
tpcds_q11/duckdb:parquet 🚀 86404130 97121251 0.89
tpcds_q12/duckdb:parquet 16878712 18221062 0.93
tpcds_q13/duckdb:parquet 35291604 36507290 0.97
tpcds_q14/duckdb:parquet 102991430 105941972 0.97
tpcds_q15/duckdb:parquet 29692079 31808780 0.93
tpcds_q16/duckdb:parquet 22525906 23465120 0.96
tpcds_q17/duckdb:parquet 38384623 40179717 0.96
tpcds_q18/duckdb:parquet 48126759 50707407 0.95
tpcds_q19/duckdb:parquet 31358394 33721806 0.93
tpcds_q20/duckdb:parquet 18631019 19505172 0.96
tpcds_q21/duckdb:parquet 11542048 12181149 0.95
tpcds_q22/duckdb:parquet 72729793 75601988 0.96
tpcds_q23/duckdb:parquet 81863115 83996026 0.97
tpcds_q24/duckdb:parquet 46463072 51196211 0.91
tpcds_q25/duckdb:parquet 35550652 37247253 0.95
tpcds_q26/duckdb:parquet 38836972 42066952 0.92
tpcds_q27/duckdb:parquet 52804841 54908041 0.96
tpcds_q28/duckdb:parquet 42840781 44260311 0.97
tpcds_q29/duckdb:parquet 38415706 38283693 1.00
tpcds_q30/duckdb:parquet 37319302 39108902 0.95
tpcds_q31/duckdb:parquet 28411525 27481882 1.03
tpcds_q32/duckdb:parquet 12483735 12983533 0.96
tpcds_q33/duckdb:parquet 23599520 24311445 0.97
tpcds_q34/duckdb:parquet 23839016 24582876 0.97
tpcds_q35/duckdb:parquet 60234319 65208876 0.92
tpcds_q36/duckdb:parquet 22702635 23185951 0.98
tpcds_q37/duckdb:parquet 13930153 15187329 0.92
tpcds_q38/duckdb:parquet 36514564 37676383 0.97
tpcds_q39/duckdb:parquet 32196990 33686693 0.96
tpcds_q40/duckdb:parquet 19455811 20649834 0.94
tpcds_q41/duckdb:parquet 8845218 9198668 0.96
tpcds_q42/duckdb:parquet 12346983 13044023 0.95
tpcds_q43/duckdb:parquet 18092063 18997288 0.95
tpcds_q44/duckdb:parquet 25955654 26989163 0.96
tpcds_q45/duckdb:parquet 29362967 30549841 0.96
tpcds_q46/duckdb:parquet 47886100 50189334 0.95
tpcds_q47/duckdb:parquet 50508962 51930636 0.97
tpcds_q48/duckdb:parquet 32192392 33074096 0.97
tpcds_q49/duckdb:parquet 28645536 29472462 0.97
tpcds_q50/duckdb:parquet 26109443 27315412 0.96
tpcds_q51/duckdb:parquet 🚨 129406076 107763726 1.20
tpcds_q52/duckdb:parquet 12886718 13183386 0.98
tpcds_q53/duckdb:parquet 19341453 19289691 1.00
tpcds_q54/duckdb:parquet 28203571 30521507 0.92
tpcds_q55/duckdb:parquet 12543688 13081886 0.96
tpcds_q56/duckdb:parquet 23633818 25386532 0.93
tpcds_q57/duckdb:parquet 38355601 40060895 0.96
tpcds_q58/duckdb:parquet 26018412 28573929 0.91
tpcds_q59/duckdb:parquet 36552070 37314257 0.98
tpcds_q60/duckdb:parquet 26278274 25791923 1.02
tpcds_q61/duckdb:parquet 33922904 34593350 0.98
tpcds_q62/duckdb:parquet 12528023 13323538 0.94
tpcds_q63/duckdb:parquet 17633131 19180737 0.92
tpcds_q64/duckdb:parquet 80297326 79357002 1.01
tpcds_q65/duckdb:parquet 22789785 23588424 0.97
tpcds_q66/duckdb:parquet 29308153 31149836 0.94
tpcds_q67/duckdb:parquet 139366408 145341378 0.96
tpcds_q68/duckdb:parquet 39548155 39914544 0.99
tpcds_q69/duckdb:parquet 38194273 39403532 0.97
tpcds_q70/duckdb:parquet 21936259 23819098 0.92
tpcds_q71/duckdb:parquet 23595319 23699606 1.00
tpcds_q72/duckdb:parquet 167697827 170824135 0.98
tpcds_q73/duckdb:parquet 20217888 20724573 0.98
tpcds_q74/duckdb:parquet 126536003 133255401 0.95
tpcds_q75/duckdb:parquet 57278747 61451740 0.93
tpcds_q76/duckdb:parquet 21645773 23136222 0.94
tpcds_q77/duckdb:parquet 25790984 25653721 1.01
tpcds_q78/duckdb:parquet 🚀 76654066 85528527 0.90
tpcds_q79/duckdb:parquet 30096842 31351900 0.96
tpcds_q80/duckdb:parquet 45511569 45821425 0.99
tpcds_q81/duckdb:parquet 34832790 36826982 0.95
tpcds_q82/duckdb:parquet 16609365 18348760 0.91
tpcds_q83/duckdb:parquet 18491294 19613136 0.94
tpcds_q84/duckdb:parquet 21668361 21680324 1.00
tpcds_q85/duckdb:parquet 42436363 43705718 0.97
tpcds_q86/duckdb:parquet 13640550 14556442 0.94
tpcds_q87/duckdb:parquet 39528805 42685845 0.93
tpcds_q88/duckdb:parquet 53532891 54972683 0.97
tpcds_q89/duckdb:parquet 22069623 23081956 0.96
tpcds_q90/duckdb:parquet 8478765 8973290 0.94
tpcds_q91/duckdb:parquet 25280130 26624079 0.95
tpcds_q92/duckdb:parquet 13033388 13629775 0.96
tpcds_q93/duckdb:parquet 31804484 33181181 0.96
tpcds_q94/duckdb:parquet 17964228 19153875 0.94
tpcds_q95/duckdb:parquet 134271490 131925992 1.02
tpcds_q96/duckdb:parquet 10392974 10750669 0.97
tpcds_q97/duckdb:parquet 37977771 40334922 0.94
tpcds_q98/duckdb:parquet 24519567 24569326 1.00
tpcds_q99/duckdb:parquet 20166054 21190983 0.95
File Size Changes (31 files changed, -43.5% overall, 2↑ 29↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-file-compressed 4.18 MB 4.26 MB +89.72 KB +2.1%
catalog_page.vortex 1.0 vortex-file-compressed 565.06 KB 565.98 KB +944 B +0.2%
customer_address.vortex 1.0 vortex-file-compressed 826.75 KB 826.00 KB 768 B -0.1%
time_dim.vortex 1.0 vortex-file-compressed 381.08 KB 380.23 KB 864 B -0.2%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.63 MB 4.57 KB -0.3%
date_dim.vortex 1.0 vortex-file-compressed 953.44 KB 938.06 KB 15.38 KB -1.6%
call_center.vortex 1.0 vortex-compact 49.33 KB 0 B 49.33 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.98 KB 0 B 362.98 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.01 MB 0 B 6.01 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 0 B 59.31 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 558.97 KB 0 B 558.97 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 649.07 KB 0 B 649.07 KB -100.0%
date_dim.vortex 1.0 vortex-compact 149.19 KB 0 B 149.19 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.29 KB 0 B 10.29 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.56 KB 0 B 5.56 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 993.73 KB 0 B 993.73 KB -100.0%
promotion.vortex 1.0 vortex-compact 51.36 KB 0 B 51.36 KB -100.0%
reason.vortex 1.0 vortex-compact 5.96 KB 0 B 5.96 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 11.09 KB 0 B 11.09 KB -100.0%
store.vortex 1.0 vortex-compact 44.86 KB 0 B 44.86 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.31 MB 0 B 9.31 MB -100.0%
store_sales.vortex 1.0 vortex-compact 77.87 MB 0 B 77.87 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.91 KB 0 B 96.91 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.33 KB 0 B 22.33 KB -100.0%
web_page.vortex 1.0 vortex-compact 26.44 KB 0 B 26.44 KB -100.0%
web_returns.vortex 1.0 vortex-compact 2.99 MB 0 B 2.99 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.35 MB 0 B 29.35 MB -100.0%
web_site.vortex 1.0 vortex-compact 44.69 KB 0 B 44.69 KB -100.0%

Totals:

  • vortex-compact: 207.47 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.82 MB → 269.89 MB (+0.0%)

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@codspeed-hq

codspeed-hq Bot commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 13.74%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 5 improved benchmarks
❌ 1 regressed benchmark
✅ 1579 untouched benchmarks
⏩ 4 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_varbinview_canonical_into[(1000, 10)] 154.8 µs 191 µs -18.98%
⚡ Simulation chunked_bool_canonical_into[(1000, 10)] 26.7 µs 16.1 µs +65.44%
⚡ Simulation chunked_varbinview_canonical_into[(100, 100)] 259.1 µs 223.8 µs +15.76%
⚡ Simulation chunked_varbinview_into_canonical[(100, 100)] 305.7 µs 270.6 µs +12.97%
⚡ Simulation bitwise_not_vortex_buffer_mut[128] 273.6 ns 244.4 ns +11.93%
⚡ Simulation eq_i64_constant 318.1 µs 288.2 µs +10.37%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing adamg/clickbench-sorted-benchmark (f8cac25) with develop (638f0c1)

Open in CodSpeed

Footnotes

  1. 4 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@AdamGS
AdamGS force-pushed the adamg/clickbench-sorted-benchmark branch from 690ead6 to adef771 Compare June 23, 2026 16:27
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jun 23, 2026
@github-actions

github-actions Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 (base)

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.6%
Engines: DataFusion No clear signal (+34.4%, environment too noisy confidence) · DuckDB No clear signal (-4.0%, environment too noisy confidence)
Vortex (geomean): 0.927x ➖
Parquet (geomean): 0.816x ➖
Shifts: Parquet (control) -18.4% · Median polish -15.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.031x ➖, 1↑ 2↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 35002807 75037795 0.47
fineweb_q01/datafusion:vortex-file-compressed 🚨 1032468750 645920127 1.60
fineweb_q02/datafusion:vortex-file-compressed 🚨 1181498342 639176039 1.85
fineweb_q03/datafusion:vortex-file-compressed 1488919563 1373154032 1.08
fineweb_q04/datafusion:vortex-file-compressed 1228247789 1199490017 1.02
fineweb_q05/datafusion:vortex-file-compressed 1128637763 1180347559 0.96
fineweb_q06/datafusion:vortex-file-compressed 1991361047 1735617740 1.15
fineweb_q07/datafusion:vortex-file-compressed 1248882156 1443719921 0.87
fineweb_q08/datafusion:vortex-file-compressed 692698569 764089289 0.91
datafusion / parquet (0.767x ➖, 3↑ 0↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1399703823 1912634446 0.73
fineweb_q01/datafusion:parquet 2911948802 2975573555 0.98
fineweb_q02/datafusion:parquet 🚀 2531122533 4561515411 0.55
fineweb_q03/datafusion:parquet 🚀 2261530592 3331702284 0.68
fineweb_q04/datafusion:parquet 2222567472 2937917142 0.76
fineweb_q05/datafusion:parquet 2985272516 3031754277 0.98
fineweb_q06/datafusion:parquet 🚀 2606817158 3743422506 0.70
fineweb_q07/datafusion:parquet 2581107447 3601158217 0.72
fineweb_q08/datafusion:parquet 2831533819 3082884063 0.92
duckdb / vortex-file-compressed (0.833x ➖, 1↑ 0↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 89182777 114898124 0.78
fineweb_q01/duckdb:vortex-file-compressed 855921628 976335070 0.88
fineweb_q02/duckdb:vortex-file-compressed 731561322 876565544 0.83
fineweb_q03/duckdb:vortex-file-compressed 1524945923 1516753791 1.01
fineweb_q04/duckdb:vortex-file-compressed 1477657193 1766946706 0.84
fineweb_q05/duckdb:vortex-file-compressed 1359784317 1489949193 0.91
fineweb_q06/duckdb:vortex-file-compressed 🚀 1448732592 2266528486 0.64
fineweb_q07/duckdb:vortex-file-compressed 1579228835 2007396054 0.79
fineweb_q08/duckdb:vortex-file-compressed 650230138 735899087 0.88
duckdb / parquet (0.868x ➖, 1↑ 0↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1370397448 1554850780 0.88
fineweb_q01/duckdb:parquet 1556363986 1729142909 0.90
fineweb_q02/duckdb:parquet 1605843630 1865894914 0.86
fineweb_q03/duckdb:parquet 🚀 4067706427 5903828082 0.69
fineweb_q04/duckdb:parquet 2515977631 2815730222 0.89
fineweb_q05/duckdb:parquet 2632691517 3311149128 0.80
fineweb_q06/duckdb:parquet 4943978417 6704554289 0.74
fineweb_q07/duckdb:parquet 3351130379 3294610537 1.02
fineweb_q08/duckdb:parquet 1284865466 1150686810 1.12

@github-actions

github-actions Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.984x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12292601 12174387 1.01
statpopgen_q01/duckdb:vortex-file-compressed 26849492 26551440 1.01
statpopgen_q02/duckdb:vortex-file-compressed 497951472 518783463 0.96
statpopgen_q03/duckdb:vortex-file-compressed 1022402454 1042269085 0.98
statpopgen_q04/duckdb:vortex-file-compressed 1047305114 1056221209 0.99
statpopgen_q05/duckdb:vortex-file-compressed 444104116 483357881 0.92
statpopgen_q06/duckdb:vortex-file-compressed 1521677336 1532573725 0.99
statpopgen_q07/duckdb:vortex-file-compressed 198206165 202733647 0.98
statpopgen_q08/duckdb:vortex-file-compressed 229124486 230763935 0.99
statpopgen_q09/duckdb:vortex-file-compressed 829831798 825410054 1.01
statpopgen_q10/duckdb:vortex-file-compressed 2551345437 2573399265 0.99
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR adef771 (ns) base dab39bf (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 305633339 306580852 1.00
statpopgen_q01/duckdb:parquet 388558213 386536075 1.01
statpopgen_q02/duckdb:parquet 763073662 771540244 0.99
statpopgen_q03/duckdb:parquet 1183036684 1204508156 0.98
statpopgen_q04/duckdb:parquet 1191493629 1199186561 0.99
statpopgen_q05/duckdb:parquet 824623510 815463073 1.01
statpopgen_q06/duckdb:parquet 1431862320 1428984585 1.00
statpopgen_q07/duckdb:parquet 858110298 869852347 0.99
statpopgen_q08/duckdb:parquet 875165907 886090199 0.99
statpopgen_q09/duckdb:parquet 1013862417 1021987258 0.99
statpopgen_q10/duckdb:parquet 2204886894 2212509232 1.00
File Size Changes (3 files changed, -32.3% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 218.99 KB -0.0%
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.32 MB 0 B 959.32 MB -100.0%

Totals:

  • vortex-compact: 959.59 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.4%
Engines: DataFusion No clear signal (-6.9%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.979x ➖, 1↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 460389460 438020028 1.05
tpch_q02/datafusion:vortex-file-compressed 103050337 102214051 1.01
tpch_q03/datafusion:vortex-file-compressed 198446157 194625586 1.02
tpch_q04/datafusion:vortex-file-compressed 95958483 94711246 1.01
tpch_q05/datafusion:vortex-file-compressed 331654418 330922399 1.00
tpch_q06/datafusion:vortex-file-compressed 36996677 35787237 1.03
tpch_q07/datafusion:vortex-file-compressed 454820383 454479092 1.00
tpch_q08/datafusion:vortex-file-compressed 339280785 346490062 0.98
tpch_q09/datafusion:vortex-file-compressed 597263866 645603831 0.93
tpch_q10/datafusion:vortex-file-compressed 232732528 252955701 0.92
tpch_q11/datafusion:vortex-file-compressed 77843185 81377508 0.96
tpch_q12/datafusion:vortex-file-compressed 108664188 113662225 0.96
tpch_q13/datafusion:vortex-file-compressed 200451079 204857071 0.98
tpch_q14/datafusion:vortex-file-compressed 47091471 49622383 0.95
tpch_q15/datafusion:vortex-file-compressed 96574262 95887016 1.01
tpch_q16/datafusion:vortex-file-compressed 75588198 76151956 0.99
tpch_q17/datafusion:vortex-file-compressed 574971179 576253909 1.00
tpch_q18/datafusion:vortex-file-compressed 834273452 844584001 0.99
tpch_q19/datafusion:vortex-file-compressed 🚀 221284626 266203024 0.83
tpch_q20/datafusion:vortex-file-compressed 157873793 164631802 0.96
tpch_q21/datafusion:vortex-file-compressed 604698828 628091203 0.96
tpch_q22/datafusion:vortex-file-compressed 56494768 55257591 1.02
datafusion / parquet (1.006x ➖, 0↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 476908806 482969413 0.99
tpch_q02/datafusion:parquet 173165821 174514245 0.99
tpch_q03/datafusion:parquet 257747338 258166933 1.00
tpch_q04/datafusion:parquet 125396046 120133054 1.04
tpch_q05/datafusion:parquet 401947459 390651496 1.03
tpch_q06/datafusion:parquet 130104585 130064086 1.00
tpch_q07/datafusion:parquet 560473960 564204021 0.99
tpch_q08/datafusion:parquet 453652407 451371808 1.01
tpch_q09/datafusion:parquet 725945863 721277032 1.01
tpch_q10/datafusion:parquet 589187857 576606318 1.02
tpch_q11/datafusion:parquet 121697772 116599193 1.04
tpch_q12/datafusion:parquet 212011942 210448523 1.01
tpch_q13/datafusion:parquet 349681343 344464757 1.02
tpch_q14/datafusion:parquet 154982228 147888369 1.05
tpch_q15/datafusion:parquet 256071374 261662550 0.98
tpch_q16/datafusion:parquet 120593122 122583515 0.98
tpch_q17/datafusion:parquet 664331883 660827786 1.01
tpch_q18/datafusion:parquet 871582137 861892060 1.01
tpch_q19/datafusion:parquet 282027714 283794507 0.99
tpch_q20/datafusion:parquet 291127403 298287657 0.98
tpch_q21/datafusion:parquet 656538679 644464678 1.02
tpch_q22/datafusion:parquet 206862725 209779120 0.99
datafusion / arrow (0.898x ✅, 8↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 691210052 776456919 0.89
tpch_q02/datafusion:arrow 🚀 109237461 129332601 0.84
tpch_q03/datafusion:arrow 🚀 499826927 586050602 0.85
tpch_q04/datafusion:arrow 🚀 363122646 441600268 0.82
tpch_q05/datafusion:arrow 🚀 736349511 832035175 0.88
tpch_q06/datafusion:arrow 🚀 322449783 372516003 0.87
tpch_q07/datafusion:arrow 🚀 1134215517 1625353841 0.70
tpch_q08/datafusion:arrow 947711742 1022516194 0.93
tpch_q09/datafusion:arrow 1080000732 1125239465 0.96
tpch_q10/datafusion:arrow 620473903 687284518 0.90
tpch_q11/datafusion:arrow 92639615 97357149 0.95
tpch_q12/datafusion:arrow 🚀 1143087821 1482960679 0.77
tpch_q13/datafusion:arrow 471097517 499798865 0.94
tpch_q14/datafusion:arrow 356890604 394018677 0.91
tpch_q15/datafusion:arrow 732368202 803935329 0.91
tpch_q16/datafusion:arrow 81176023 83943035 0.97
tpch_q17/datafusion:arrow 957415040 1040335672 0.92
tpch_q18/datafusion:arrow 1809337820 1924474970 0.94
tpch_q19/datafusion:arrow 538976276 573423285 0.94
tpch_q20/datafusion:arrow 492780573 522383983 0.94
tpch_q21/datafusion:arrow 3111456606 3208915502 0.97
tpch_q22/datafusion:arrow 80529778 79905883 1.01
duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169371020 168834468 1.00
tpch_q02/duckdb:vortex-file-compressed 55265460 54457168 1.01
tpch_q03/duckdb:vortex-file-compressed 123578769 120678467 1.02
tpch_q04/duckdb:vortex-file-compressed 161105925 156725331 1.03
tpch_q05/duckdb:vortex-file-compressed 138212478 138249515 1.00
tpch_q06/duckdb:vortex-file-compressed 32224080 31766008 1.01
tpch_q07/duckdb:vortex-file-compressed 136265763 135719997 1.00
tpch_q08/duckdb:vortex-file-compressed 174811324 171693598 1.02
tpch_q09/duckdb:vortex-file-compressed 399362682 392082406 1.02
tpch_q10/duckdb:vortex-file-compressed 197609790 193956048 1.02
tpch_q11/duckdb:vortex-file-compressed 33499954 31731007 1.06
tpch_q12/duckdb:vortex-file-compressed 104738689 103947701 1.01
tpch_q13/duckdb:vortex-file-compressed 270418558 273936831 0.99
tpch_q14/duckdb:vortex-file-compressed 53352690 52729342 1.01
tpch_q15/duckdb:vortex-file-compressed 87923836 85903247 1.02
tpch_q16/duckdb:vortex-file-compressed 78495185 77829413 1.01
tpch_q17/duckdb:vortex-file-compressed 92298024 90963048 1.01
tpch_q18/duckdb:vortex-file-compressed 292438616 293802275 1.00
tpch_q19/duckdb:vortex-file-compressed 78591590 79434143 0.99
tpch_q20/duckdb:vortex-file-compressed 141020912 141089494 1.00
tpch_q21/duckdb:vortex-file-compressed 497776675 496707519 1.00
tpch_q22/duckdb:vortex-file-compressed 63423415 63229666 1.00
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265742875 262812997 1.01
tpch_q02/duckdb:parquet 101870184 94768876 1.07
tpch_q03/duckdb:parquet 208894126 210208762 0.99
tpch_q04/duckdb:parquet 134348843 135586685 0.99
tpch_q05/duckdb:parquet 224498179 221584881 1.01
tpch_q06/duckdb:parquet 72583186 74276822 0.98
tpch_q07/duckdb:parquet 186411268 186185981 1.00
tpch_q08/duckdb:parquet 260880094 260731491 1.00
tpch_q09/duckdb:parquet 474579782 469940853 1.01
tpch_q10/duckdb:parquet 615696890 616150836 1.00
tpch_q11/duckdb:parquet 62768382 62610600 1.00
tpch_q12/duckdb:parquet 133317031 131456585 1.01
tpch_q13/duckdb:parquet 440026181 447695700 0.98
tpch_q14/duckdb:parquet 180258328 177465930 1.02
tpch_q15/duckdb:parquet 103207201 104667316 0.99
tpch_q16/duckdb:parquet 160382086 161720625 0.99
tpch_q17/duckdb:parquet 183415455 180169620 1.02
tpch_q18/duckdb:parquet 361646142 360913555 1.00
tpch_q19/duckdb:parquet 288805837 284897731 1.01
tpch_q20/duckdb:parquet 231261899 229412079 1.01
tpch_q21/duckdb:parquet 550293691 553414926 0.99
tpch_q22/duckdb:parquet 295674277 291820352 1.01
File Size Changes (47 files changed, -44.5% overall, 13↑ 34↓)
File Scale Format Base HEAD Change %
supplier_0.vortex 10.0 vortex-file-compressed 5.74 MB 5.78 MB +41.51 KB +0.7%
orders_2.vortex 10.0 vortex-file-compressed 134.47 MB 134.72 MB +252.79 KB +0.2%
lineitem_7.vortex 10.0 vortex-file-compressed 129.26 MB 129.48 MB +216.90 KB +0.2%
lineitem_3.vortex 10.0 vortex-file-compressed 129.28 MB 129.46 MB +184.09 KB +0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 129.27 MB 129.45 MB +181.49 KB +0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 129.06 MB 129.19 MB +131.84 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 129.14 MB 129.20 MB +59.95 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.39 MB 129.45 MB +57.77 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.75 MB 119.80 MB +51.51 KB +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.49 MB 129.53 MB +40.69 KB +0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 129.44 MB 129.48 MB +40.00 KB +0.0%
orders_0.vortex 10.0 vortex-file-compressed 133.29 MB 133.30 MB +9.62 KB +0.0%
lineitem_0.vortex 10.0 vortex-file-compressed 129.51 MB 129.51 MB +5.87 KB +0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 119.79 MB 119.75 MB 48.97 KB -0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 129.20 MB 129.13 MB 70.09 KB -0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.55 MB 88.50 MB 54.02 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.47 MB 129.36 MB 111.30 KB -0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 129.44 MB 129.31 MB 141.76 KB -0.1%
part_1.vortex 10.0 vortex-file-compressed 24.79 MB 24.74 MB 55.20 KB -0.2%
lineitem_12.vortex 10.0 vortex-file-compressed 129.58 MB 129.27 MB 312.86 KB -0.2%
orders_1.vortex 10.0 vortex-file-compressed 134.63 MB 134.29 MB 353.41 KB -0.3%
part_0.vortex 10.0 vortex-file-compressed 24.74 MB 24.67 MB 72.95 KB -0.3%
customer_0.vortex 10.0 vortex-compact 74.12 MB 0 B 74.12 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem_0.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_1.vortex 10.0 vortex-compact 100.64 MB 0 B 100.64 MB -100.0%
lineitem_10.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_11.vortex 10.0 vortex-compact 100.53 MB 0 B 100.53 MB -100.0%
lineitem_12.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_2.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_3.vortex 10.0 vortex-compact 100.62 MB 0 B 100.62 MB -100.0%
lineitem_4.vortex 10.0 vortex-compact 100.56 MB 0 B 100.56 MB -100.0%
lineitem_5.vortex 10.0 vortex-compact 100.70 MB 0 B 100.70 MB -100.0%
lineitem_6.vortex 10.0 vortex-compact 100.68 MB 0 B 100.68 MB -100.0%
lineitem_7.vortex 10.0 vortex-compact 100.58 MB 0 B 100.58 MB -100.0%
lineitem_8.vortex 10.0 vortex-compact 100.59 MB 0 B 100.59 MB -100.0%
lineitem_9.vortex 10.0 vortex-compact 100.46 MB 0 B 100.46 MB -100.0%
nation_0.vortex 10.0 vortex-compact 8.18 KB 0 B 8.18 KB -100.0%
orders_0.vortex 10.0 vortex-compact 114.79 MB 0 B 114.79 MB -100.0%
orders_1.vortex 10.0 vortex-compact 114.76 MB 0 B 114.76 MB -100.0%
orders_2.vortex 10.0 vortex-compact 114.78 MB 0 B 114.78 MB -100.0%
part_0.vortex 10.0 vortex-compact 17.00 MB 0 B 17.00 MB -100.0%
part_1.vortex 10.0 vortex-compact 16.74 MB 0 B 16.74 MB -100.0%
partsupp_0.vortex 10.0 vortex-compact 105.09 MB 0 B 105.09 MB -100.0%
partsupp_1.vortex 10.0 vortex-compact 104.64 MB 0 B 104.64 MB -100.0%
region_0.vortex 10.0 vortex-compact 5.83 KB 0 B 5.83 KB -100.0%
supplier_0.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.93 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME (base)

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-2.9%, low confidence)
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.986x ➖, 2↑ 2↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1574863 2392285 0.66
clickbench_q01/datafusion:vortex-file-compressed 15803580 16059220 0.98
clickbench_q02/datafusion:vortex-file-compressed 33903602 36106559 0.94
clickbench_q03/datafusion:vortex-file-compressed 40264406 40359391 1.00
clickbench_q04/datafusion:vortex-file-compressed 229599017 236432903 0.97
clickbench_q05/datafusion:vortex-file-compressed 309945699 303901838 1.02
clickbench_q06/datafusion:vortex-file-compressed 1620054 1613833 1.00
clickbench_q07/datafusion:vortex-file-compressed 19839087 20075611 0.99
clickbench_q08/datafusion:vortex-file-compressed 321945894 331250903 0.97
clickbench_q09/datafusion:vortex-file-compressed 439044540 466480059 0.94
clickbench_q10/datafusion:vortex-file-compressed 70985416 71629540 0.99
clickbench_q11/datafusion:vortex-file-compressed 82943090 87468798 0.95
clickbench_q12/datafusion:vortex-file-compressed 258007809 261874034 0.99
clickbench_q13/datafusion:vortex-file-compressed 414757262 415794984 1.00
clickbench_q14/datafusion:vortex-file-compressed 256122003 261644245 0.98
clickbench_q15/datafusion:vortex-file-compressed 276098074 277667362 0.99
clickbench_q16/datafusion:vortex-file-compressed 645888295 652045072 0.99
clickbench_q17/datafusion:vortex-file-compressed 632298078 645602966 0.98
clickbench_q18/datafusion:vortex-file-compressed 1349837765 1356928931 0.99
clickbench_q19/datafusion:vortex-file-compressed 27076820 28199082 0.96
clickbench_q20/datafusion:vortex-file-compressed 309388808 317795914 0.97
clickbench_q21/datafusion:vortex-file-compressed 395276523 398594616 0.99
clickbench_q22/datafusion:vortex-file-compressed 495622229 508094009 0.98
clickbench_q23/datafusion:vortex-file-compressed 765670449 790109090 0.97
clickbench_q24/datafusion:vortex-file-compressed 41346571 41755541 0.99
clickbench_q25/datafusion:vortex-file-compressed 73945556 71686050 1.03
clickbench_q26/datafusion:vortex-file-compressed 41583556 44078521 0.94
clickbench_q27/datafusion:vortex-file-compressed 422511466 419046903 1.01
clickbench_q28/datafusion:vortex-file-compressed 2383045031 2381388994 1.00
clickbench_q29/datafusion:vortex-file-compressed 67566422 64018058 1.06
clickbench_q30/datafusion:vortex-file-compressed 🚨 257775539 226185969 1.14
clickbench_q31/datafusion:vortex-file-compressed 🚨 277287030 243359776 1.14
clickbench_q32/datafusion:vortex-file-compressed 1159287000 1059585232 1.09
clickbench_q33/datafusion:vortex-file-compressed 1409701926 1413287548 1.00
clickbench_q34/datafusion:vortex-file-compressed 1415552883 1413813902 1.00
clickbench_q35/datafusion:vortex-file-compressed 244231268 232995939 1.05
clickbench_q36/datafusion:vortex-file-compressed 59641336 55070709 1.08
clickbench_q37/datafusion:vortex-file-compressed 25918072 25186202 1.03
clickbench_q38/datafusion:vortex-file-compressed 🚀 15789045 18008982 0.88
clickbench_q39/datafusion:vortex-file-compressed 124676062 124632270 1.00
clickbench_q40/datafusion:vortex-file-compressed 12547854 13341976 0.94
clickbench_q41/datafusion:vortex-file-compressed 12257952 12763734 0.96
clickbench_q42/datafusion:vortex-file-compressed 11298080 11544766 0.98
datafusion / parquet (0.988x ➖, 1↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1722655 1604793 1.07
clickbench_q01/datafusion:parquet 19558100 19837449 0.99
clickbench_q02/datafusion:parquet 44041051 45592523 0.97
clickbench_q03/datafusion:parquet 34434815 34673020 0.99
clickbench_q04/datafusion:parquet 259071278 278699371 0.93
clickbench_q05/datafusion:parquet 316566130 312671269 1.01
clickbench_q06/datafusion:parquet 1531081 1585075 0.97
clickbench_q07/datafusion:parquet 21696989 21611055 1.00
clickbench_q08/datafusion:parquet 333645647 329683552 1.01
clickbench_q09/datafusion:parquet 481449995 469347766 1.03
clickbench_q10/datafusion:parquet 92779038 91327951 1.02
clickbench_q11/datafusion:parquet 118656542 114583719 1.04
clickbench_q12/datafusion:parquet 301745858 295631242 1.02
clickbench_q13/datafusion:parquet 463462441 461301498 1.00
clickbench_q14/datafusion:parquet 309196724 305287422 1.01
clickbench_q15/datafusion:parquet 290652818 277136643 1.05
clickbench_q16/datafusion:parquet 642644964 661517369 0.97
clickbench_q17/datafusion:parquet 643338619 628787533 1.02
clickbench_q18/datafusion:parquet 1356256642 1361291830 1.00
clickbench_q19/datafusion:parquet 26840046 26214624 1.02
clickbench_q20/datafusion:parquet 562426246 572809377 0.98
clickbench_q21/datafusion:parquet 618084790 617806025 1.00
clickbench_q22/datafusion:parquet 902264268 920299281 0.98
clickbench_q23/datafusion:parquet 4028599382 4120585073 0.98
clickbench_q24/datafusion:parquet 53668229 56951585 0.94
clickbench_q25/datafusion:parquet 126385801 125489930 1.01
clickbench_q26/datafusion:parquet 52671587 55962919 0.94
clickbench_q27/datafusion:parquet 640286797 662926188 0.97
clickbench_q28/datafusion:parquet 2436876434 2459882198 0.99
clickbench_q29/datafusion:parquet 🚀 44313217 54057411 0.82
clickbench_q30/datafusion:parquet 314526387 317052956 0.99
clickbench_q31/datafusion:parquet 341273784 351100855 0.97
clickbench_q32/datafusion:parquet 1095741108 1092539148 1.00
clickbench_q33/datafusion:parquet 1490681632 1510068880 0.99
clickbench_q34/datafusion:parquet 1485020281 1495123743 0.99
clickbench_q35/datafusion:parquet 243101478 250535369 0.97
clickbench_q36/datafusion:parquet 104814557 109187000 0.96
clickbench_q37/datafusion:parquet 40336165 43336103 0.93
clickbench_q38/datafusion:parquet 61737201 64812069 0.95
clickbench_q39/datafusion:parquet 207848633 208800364 1.00
clickbench_q40/datafusion:parquet 23651782 22027301 1.07
clickbench_q41/datafusion:parquet 21010233 21434208 0.98
clickbench_q42/datafusion:parquet 21610076 21802713 0.99
duckdb / vortex-file-compressed (0.975x ➖, 5↑ 4↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6498104 6898550 0.94
clickbench_q01/duckdb:vortex-file-compressed 🚀 10331860 12327939 0.84
clickbench_q02/duckdb:vortex-file-compressed 25394043 24775231 1.02
clickbench_q03/duckdb:vortex-file-compressed 31740552 33086083 0.96
clickbench_q04/duckdb:vortex-file-compressed 196906521 200861484 0.98
clickbench_q05/duckdb:vortex-file-compressed 185740269 193697232 0.96
clickbench_q06/duckdb:vortex-file-compressed 21011864 21468055 0.98
clickbench_q07/duckdb:vortex-file-compressed 🚨 17093952 15328734 1.12
clickbench_q08/duckdb:vortex-file-compressed 279416150 289026802 0.97
clickbench_q09/duckdb:vortex-file-compressed 346891095 375739726 0.92
clickbench_q10/duckdb:vortex-file-compressed 71827891 77276706 0.93
clickbench_q11/duckdb:vortex-file-compressed 🚀 79296532 90358641 0.88
clickbench_q12/duckdb:vortex-file-compressed 201377366 218393755 0.92
clickbench_q13/duckdb:vortex-file-compressed 423111640 462245597 0.92
clickbench_q14/duckdb:vortex-file-compressed 234208965 253022521 0.93
clickbench_q15/duckdb:vortex-file-compressed 245010558 256835962 0.95
clickbench_q16/duckdb:vortex-file-compressed 540469975 560263212 0.96
clickbench_q17/duckdb:vortex-file-compressed 463218745 455618794 1.02
clickbench_q18/duckdb:vortex-file-compressed 985428869 991450407 0.99
clickbench_q19/duckdb:vortex-file-compressed 22259649 23630483 0.94
clickbench_q20/duckdb:vortex-file-compressed 313283000 312128614 1.00
clickbench_q21/duckdb:vortex-file-compressed 🚨 438867624 394253473 1.11
clickbench_q22/duckdb:vortex-file-compressed 613315752 562112474 1.09
clickbench_q23/duckdb:vortex-file-compressed 203841184 190229376 1.07
clickbench_q24/duckdb:vortex-file-compressed 38330020 41304354 0.93
clickbench_q25/duckdb:vortex-file-compressed 🚨 89442062 81069729 1.10
clickbench_q26/duckdb:vortex-file-compressed 🚨 58387013 51012828 1.14
clickbench_q27/duckdb:vortex-file-compressed 232469832 221494676 1.05
clickbench_q28/duckdb:vortex-file-compressed 3161933704 3097842670 1.02
clickbench_q29/duckdb:vortex-file-compressed 28641883 30544165 0.94
clickbench_q30/duckdb:vortex-file-compressed 199565482 212175977 0.94
clickbench_q31/duckdb:vortex-file-compressed 303557357 321049646 0.95
clickbench_q32/duckdb:vortex-file-compressed 1236771422 1206720560 1.02
clickbench_q33/duckdb:vortex-file-compressed 1253643504 1257856740 1.00
clickbench_q34/duckdb:vortex-file-compressed 1371296318 1280053106 1.07
clickbench_q35/duckdb:vortex-file-compressed 404950591 403137375 1.00
clickbench_q36/duckdb:vortex-file-compressed 32358146 34788867 0.93
clickbench_q37/duckdb:vortex-file-compressed 22321247 23227993 0.96
clickbench_q38/duckdb:vortex-file-compressed 27445341 28222019 0.97
clickbench_q39/duckdb:vortex-file-compressed 🚀 49216381 56354062 0.87
clickbench_q40/duckdb:vortex-file-compressed 🚀 22202081 25197094 0.88
clickbench_q41/duckdb:vortex-file-compressed 🚀 21537485 24729188 0.87
clickbench_q42/duckdb:vortex-file-compressed 25351027 26399021 0.96
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR adef771 (ns) base 809e2a4 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23677995 23698553 1.00
clickbench_q01/duckdb:parquet 29277248 29834722 0.98
clickbench_q02/duckdb:parquet 50088325 50478730 0.99
clickbench_q03/duckdb:parquet 41362007 41814191 0.99
clickbench_q04/duckdb:parquet 204243943 206185470 0.99
clickbench_q05/duckdb:parquet 258710948 262648594 0.99
clickbench_q06/duckdb:parquet 47715456 46831304 1.02
clickbench_q07/duckdb:parquet 31339197 31647778 0.99
clickbench_q08/duckdb:parquet 274328164 271102302 1.01
clickbench_q09/duckdb:parquet 402997901 401834498 1.00
clickbench_q10/duckdb:parquet 83271606 82509965 1.01
clickbench_q11/duckdb:parquet 101451483 101574963 1.00
clickbench_q12/duckdb:parquet 280639184 279976513 1.00
clickbench_q13/duckdb:parquet 475478309 477779182 1.00
clickbench_q14/duckdb:parquet 318270350 319146181 1.00
clickbench_q15/duckdb:parquet 258440954 259761832 0.99
clickbench_q16/duckdb:parquet 597155350 602582424 0.99
clickbench_q17/duckdb:parquet 497217795 499403163 1.00
clickbench_q18/duckdb:parquet 1057919318 1045379403 1.01
clickbench_q19/duckdb:parquet 28845229 27734489 1.04
clickbench_q20/duckdb:parquet 437832545 420175633 1.04
clickbench_q21/duckdb:parquet 544798470 536823154 1.01
clickbench_q22/duckdb:parquet 921951441 917360528 1.01
clickbench_q23/duckdb:parquet 267457910 277043711 0.97
clickbench_q24/duckdb:parquet 73642221 70207394 1.05
clickbench_q25/duckdb:parquet 164061684 162300502 1.01
clickbench_q26/duckdb:parquet 54946749 55362382 0.99
clickbench_q27/duckdb:parquet 480414649 471501725 1.02
clickbench_q28/duckdb:parquet 4845822440 4803114154 1.01
clickbench_q29/duckdb:parquet 43491995 42629936 1.02
clickbench_q30/duckdb:parquet 335167083 314325450 1.07
clickbench_q31/duckdb:parquet 410102088 380739310 1.08
clickbench_q32/duckdb:parquet 1177813439 1134835780 1.04
clickbench_q33/duckdb:parquet 1109227236 1123448062 0.99
clickbench_q34/duckdb:parquet 1152572947 1195506762 0.96
clickbench_q35/duckdb:parquet 374152013 388316151 0.96
clickbench_q36/duckdb:parquet 47245685 48533489 0.97
clickbench_q37/duckdb:parquet 34453828 34757388 0.99
clickbench_q38/duckdb:parquet 35037636 36185430 0.97
clickbench_q39/duckdb:parquet 81591776 83044049 0.98
clickbench_q40/duckdb:parquet 20395305 20442588 1.00
clickbench_q41/duckdb:parquet 20532191 20567063 1.00
clickbench_q42/duckdb:parquet 22860160 21842282 1.05
File Size Changes (201 files changed, -39.1% overall, 47↑ 154↓)
File Scale Format Base HEAD Change %
hits_53.vortex 1.0 vortex-file-compressed 85.28 MB 85.76 MB +494.40 KB +0.6%
hits_98.vortex 1.0 vortex-file-compressed 118.11 MB 118.32 MB +212.28 KB +0.2%
hits_5.vortex 1.0 vortex-file-compressed 92.87 MB 93.01 MB +144.12 KB +0.2%
hits_67.vortex 1.0 vortex-file-compressed 183.78 MB 184.05 MB +268.63 KB +0.1%
hits_84.vortex 1.0 vortex-file-compressed 116.76 MB 116.92 MB +163.90 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.30 MB 68.40 MB +93.19 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 93.85 MB 93.94 MB +94.67 KB +0.1%
hits_41.vortex 1.0 vortex-file-compressed 222.84 MB 223.06 MB +220.34 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.12 MB 138.25 MB +132.08 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 106.69 MB 106.78 MB +95.65 KB +0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.08 MB 99.16 MB +85.74 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.05 MB 69.10 MB +55.33 KB +0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.25 MB 117.34 MB +90.01 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 76.82 MB 76.87 MB +58.31 KB +0.1%
hits_42.vortex 1.0 vortex-file-compressed 221.73 MB 221.86 MB +132.88 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.02 MB 57.06 MB +33.07 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 101.55 MB 101.60 MB +57.98 KB +0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.37 MB 59.40 MB +31.68 KB +0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.27 MB 93.32 MB +48.20 KB +0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.42 MB 84.46 MB +43.23 KB +0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.26 MB 87.30 MB +42.70 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 127.99 MB 128.05 MB +59.76 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.49 MB 62.52 MB +29.13 KB +0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.11 MB 89.14 MB +32.92 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 141.77 MB 141.82 MB +51.30 KB +0.0%
hits_24.vortex 1.0 vortex-file-compressed 75.98 MB 76.01 MB +26.99 KB +0.0%
hits_49.vortex 1.0 vortex-file-compressed 75.42 MB 75.44 MB +26.40 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.50 MB 101.53 MB +34.19 KB +0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.10 MB 168.16 MB +55.52 KB +0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.20 MB 63.23 MB +20.80 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.15 MB 90.18 MB +27.85 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.18 MB 184.23 MB +50.57 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.00 MB 101.02 MB +24.64 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.97 MB 105.00 MB +23.91 KB +0.0%
hits_35.vortex 1.0 vortex-file-compressed 114.95 MB 114.98 MB +23.95 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 100.76 MB 100.78 MB +19.71 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.11 MB 123.14 MB +21.73 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.38 MB 97.40 MB +16.86 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 109.29 MB 109.31 MB +16.45 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.23 MB 111.24 MB +15.38 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.07 MB 96.08 MB +11.38 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.47 MB 183.49 MB +16.50 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.68 MB 119.69 MB +9.95 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.21 MB 90.21 MB +4.36 KB +0.0%
hits_3.vortex 1.0 vortex-file-compressed 141.67 MB 141.67 MB +6.49 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 226.39 MB 226.39 MB +2.80 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.18 MB 179.18 MB +1.26 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.23 MB 135.22 MB 4.72 KB -0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.32 MB 108.31 MB 4.52 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.13 MB 90.11 MB 13.52 KB -0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.32 MB 85.31 MB 13.50 KB -0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.54 MB 277.49 MB 44.05 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.44 MB 89.42 MB 14.55 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.24 MB 41.23 MB 7.52 KB -0.0%
hits_73.vortex 1.0 vortex-file-compressed 109.34 MB 109.32 MB 20.03 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 80.94 MB 80.92 MB 18.21 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.18 MB 164.14 MB 41.48 KB -0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.25 MB 73.23 MB 18.98 KB -0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.37 MB 146.33 MB 38.26 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 76.46 MB 76.44 MB 21.21 KB -0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.32 MB 104.29 MB 30.73 KB -0.0%
hits_44.vortex 1.0 vortex-file-compressed 186.03 MB 185.97 MB 61.02 KB -0.0%
hits_69.vortex 1.0 vortex-file-compressed 122.91 MB 122.87 MB 43.07 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.05 MB 69.03 MB 25.65 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.49 MB 119.44 MB 49.47 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.26 MB 93.22 MB 40.22 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.34 MB 122.29 MB 54.29 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 122.85 MB 122.80 MB 54.73 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.06 MB 99.02 MB 45.34 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 122.74 MB 122.68 MB 62.56 KB -0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.10 MB 186.00 MB 97.46 KB -0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.53 MB 91.48 MB 55.27 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.11 MB 80.06 MB 48.45 KB -0.1%
hits_30.vortex 1.0 vortex-file-compressed 86.80 MB 86.75 MB 53.50 KB -0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.26 MB 103.19 MB 69.74 KB -0.1%
hits_54.vortex 1.0 vortex-file-compressed 221.24 MB 221.09 MB 154.02 KB -0.1%
hits_88.vortex 1.0 vortex-file-compressed 110.94 MB 110.86 MB 84.14 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.09 MB 122.00 MB 94.52 KB -0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.31 MB 172.18 MB 134.59 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.40 MB 69.35 MB 55.78 KB -0.1%
hits_91.vortex 1.0 vortex-file-compressed 96.89 MB 96.81 MB 86.99 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.67 MB 117.56 MB 106.41 KB -0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.72 MB 100.63 MB 93.36 KB -0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.43 MB 138.29 MB 135.48 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.07 MB 69.00 MB 77.52 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 103.61 MB 103.49 MB 119.41 KB -0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.27 MB 89.17 MB 103.48 KB -0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.43 MB 93.33 MB 109.03 KB -0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.05 MB 28.01 MB 39.38 KB -0.1%
hits_21.vortex 1.0 vortex-file-compressed 92.86 MB 92.73 MB 133.73 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 113.96 MB 113.80 MB 166.13 KB -0.1%
hits_11.vortex 1.0 vortex-file-compressed 79.84 MB 79.71 MB 125.67 KB -0.2%
hits_31.vortex 1.0 vortex-file-compressed 90.13 MB 89.98 MB 152.99 KB -0.2%
hits_32.vortex 1.0 vortex-file-compressed 66.61 MB 66.49 MB 119.14 KB -0.2%
hits_9.vortex 1.0 vortex-file-compressed 99.12 MB 98.93 MB 198.60 KB -0.2%
hits_79.vortex 1.0 vortex-file-compressed 144.10 MB 143.81 MB 293.41 KB -0.2%
hits_25.vortex 1.0 vortex-file-compressed 113.43 MB 113.14 MB 295.09 KB -0.3%
hits_16.vortex 1.0 vortex-file-compressed 79.62 MB 79.27 MB 359.01 KB -0.4%
hits_82.vortex 1.0 vortex-file-compressed 99.95 MB 99.46 MB 505.56 KB -0.5%
hits_55.vortex 1.0 vortex-file-compressed 169.00 MB 166.24 MB 2.77 MB -1.6%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.57 MB 0 B 58.57 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.19 MB 0 B 90.19 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.75 MB 0 B 48.75 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.22 MB 0 B 54.22 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.16 MB 0 B 69.16 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.86 MB 0 B 67.86 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.60 MB 0 B 73.60 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.94 MB 0 B 47.94 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.07 MB 0 B 48.07 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.15 MB 0 B 58.15 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.13 MB 0 B 64.13 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.73 MB 0 B 44.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.13 MB 0 B 129.13 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.00 MB 0 B 38.00 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.38 MB 0 B 51.38 MB -100.0%
hits_22.vortex 1.0 vortex-compact 44.49 MB 0 B 44.49 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.92 MB 0 B 43.92 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.38 MB 0 B 43.38 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.93 MB 0 B 72.93 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.73 MB 0 B 70.73 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.80 MB 0 B 69.80 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.18 MB 0 B 70.18 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.49 MB 0 B 36.49 MB -100.0%
hits_3.vortex 1.0 vortex-compact 94.05 MB 0 B 94.05 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.56 MB 0 B 58.56 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.41 MB 0 B 55.41 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.03 MB 0 B 44.03 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.85 MB 0 B 35.85 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.09 MB 0 B 58.09 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.95 MB 0 B 74.95 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.90 MB 0 B 48.90 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.68 MB 0 B 53.68 MB -100.0%
hits_38.vortex 1.0 vortex-compact 62.96 MB 0 B 62.96 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.69 MB 0 B 49.69 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.69 MB 0 B 71.69 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.74 MB 0 B 75.74 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.52 MB 0 B 165.52 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.97 MB 0 B 163.97 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.64 MB 0 B 168.64 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.24 MB 0 B 132.24 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.87 MB 0 B 75.87 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.82 MB 0 B 41.82 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.19 MB 0 B 18.19 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.27 MB 0 B 17.27 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.42 MB 0 B 50.42 MB -100.0%
hits_5.vortex 1.0 vortex-compact 62.83 MB 0 B 62.83 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.99 MB 0 B 112.99 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.75 MB 0 B 167.75 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.54 MB 0 B 63.54 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.56 MB 0 B 117.56 MB -100.0%
hits_55.vortex 1.0 vortex-compact 96.03 MB 0 B 96.03 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.75 MB 0 B 77.75 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.35 MB 0 B 83.35 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.31 MB 0 B 60.31 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.15 MB 0 B 66.15 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.08 MB 0 B 63.08 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.15 MB 0 B 64.15 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.46 MB 0 B 57.46 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.08 MB 0 B 74.08 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.00 MB 0 B 46.00 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.78 MB 0 B 53.78 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.70 MB 0 B 129.70 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.36 MB 0 B 53.36 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.93 MB 0 B 113.93 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.85 MB 0 B 75.85 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.82 MB 0 B 80.82 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.72 MB 0 B 63.72 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.16 MB 0 B 61.16 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.17 MB 0 B 69.17 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.60 MB 0 B 51.60 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.83 MB 0 B 69.83 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.46 MB 0 B 71.46 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.56 MB 0 B 43.56 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.27 MB 0 B 76.27 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.90 MB 0 B 117.90 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.80 MB 0 B 97.80 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.53 MB 0 B 85.53 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.81 MB 0 B 62.81 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.87 MB 0 B 67.87 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.33 MB 0 B 65.33 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.99 MB 0 B 66.99 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.39 MB 0 B 52.39 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.94 MB 0 B 72.94 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.53 MB 0 B 52.53 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.15 MB 0 B 48.15 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.82 MB 0 B 118.82 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.70 MB 0 B 112.70 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.54 MB 0 B 65.54 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.51 MB 0 B 82.51 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.77 MB 0 B 60.77 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.11 MB 0 B 94.11 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.73 MB 0 B 58.73 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.48 MB 0 B 90.48 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.60 MB 0 B 57.60 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.92 MB 0 B 90.92 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.03 MB 0 B 69.03 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.60 MB 0 B 72.60 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.16 MB 0 B 77.16 MB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 0 B (-100.0%)
  • vortex-file-compressed: 10.98 GB → 10.97 GB (-0.0%)

@AdamGS
AdamGS requested review from a10y and robert3005 June 23, 2026 16:44
@AdamGS
AdamGS marked this pull request as ready for review June 23, 2026 16:46
@AdamGS
AdamGS requested a review from a team June 23, 2026 16:46
@AdamGS
AdamGS force-pushed the adamg/clickbench-sorted-benchmark branch from adef771 to 5fc5ff0 Compare June 23, 2026 16:46
@github-actions

github-actions Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 (base)

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-11.2%, environment too noisy confidence) · DuckDB No clear signal (+3.8%, environment too noisy confidence)
Vortex (geomean): 0.866x ➖
Parquet (geomean): 0.902x ➖
Shifts: Parquet (control) -9.8% · Median polish -11.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.816x ➖, 9↑ 1↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 441624898 347742762 1.27
tpch_q02/datafusion:vortex-file-compressed 1030621628 829825261 1.24
tpch_q03/datafusion:vortex-file-compressed 738021758 833354887 0.89
tpch_q04/datafusion:vortex-file-compressed 🚀 339690014 580440606 0.59
tpch_q05/datafusion:vortex-file-compressed 🚀 554669138 1165021474 0.48
tpch_q06/datafusion:vortex-file-compressed 🚀 439466547 659512554 0.67
tpch_q07/datafusion:vortex-file-compressed 659257112 714588520 0.92
tpch_q08/datafusion:vortex-file-compressed 804547675 1079429440 0.75
tpch_q09/datafusion:vortex-file-compressed 🚀 542844213 804270833 0.67
tpch_q10/datafusion:vortex-file-compressed 🚀 543530806 971620677 0.56
tpch_q11/datafusion:vortex-file-compressed 🚨 693264636 488486442 1.42
tpch_q12/datafusion:vortex-file-compressed 736163178 569235116 1.29
tpch_q13/datafusion:vortex-file-compressed 211492413 265405602 0.80
tpch_q14/datafusion:vortex-file-compressed 417337345 396491732 1.05
tpch_q15/datafusion:vortex-file-compressed 616907100 701816101 0.88
tpch_q16/datafusion:vortex-file-compressed 372477814 325633484 1.14
tpch_q17/datafusion:vortex-file-compressed 569318538 775043727 0.73
tpch_q18/datafusion:vortex-file-compressed 🚀 391306928 603415614 0.65
tpch_q19/datafusion:vortex-file-compressed 753303283 886380799 0.85
tpch_q20/datafusion:vortex-file-compressed 🚀 521856587 763904032 0.68
tpch_q21/datafusion:vortex-file-compressed 🚀 553649955 962446088 0.58
tpch_q22/datafusion:vortex-file-compressed 🚀 294361142 423110722 0.70
datafusion / parquet (0.919x ➖, 3↑ 3↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 224673466 236018770 0.95
tpch_q02/datafusion:parquet 🚀 434613497 675847450 0.64
tpch_q03/datafusion:parquet 🚀 443077991 947130825 0.47
tpch_q04/datafusion:parquet 🚀 204835353 436175149 0.47
tpch_q05/datafusion:parquet 645822606 873419658 0.74
tpch_q06/datafusion:parquet 246746176 267863716 0.92
tpch_q07/datafusion:parquet 668632508 738319879 0.91
tpch_q08/datafusion:parquet 790240421 841082783 0.94
tpch_q09/datafusion:parquet 471045415 614676323 0.77
tpch_q10/datafusion:parquet 🚨 1076340181 807730638 1.33
tpch_q11/datafusion:parquet 🚨 751061000 449570225 1.67
tpch_q12/datafusion:parquet 374382307 465114779 0.80
tpch_q13/datafusion:parquet 432767191 508526750 0.85
tpch_q14/datafusion:parquet 392836320 353433380 1.11
tpch_q15/datafusion:parquet 594201976 534579700 1.11
tpch_q16/datafusion:parquet 408864257 342352107 1.19
tpch_q17/datafusion:parquet 722709461 588946920 1.23
tpch_q18/datafusion:parquet 608347526 630339126 0.97
tpch_q19/datafusion:parquet 574096334 549604565 1.04
tpch_q20/datafusion:parquet 🚨 518388652 333800830 1.55
tpch_q21/datafusion:parquet 900271135 1059686188 0.85
tpch_q22/datafusion:parquet 266069781 371546929 0.72
duckdb / vortex-file-compressed (0.918x ➖, 1↑ 0↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 294336814 443044264 0.66
tpch_q02/duckdb:vortex-file-compressed 1192089512 1333171354 0.89
tpch_q03/duckdb:vortex-file-compressed 751937360 938454330 0.80
tpch_q04/duckdb:vortex-file-compressed 511875089 602661700 0.85
tpch_q05/duckdb:vortex-file-compressed 887288174 1079354092 0.82
tpch_q06/duckdb:vortex-file-compressed 368631963 464587783 0.79
tpch_q07/duckdb:vortex-file-compressed 1221042792 1182595433 1.03
tpch_q08/duckdb:vortex-file-compressed 1462556847 1443723859 1.01
tpch_q09/duckdb:vortex-file-compressed 1125344153 1273606443 0.88
tpch_q10/duckdb:vortex-file-compressed 827494815 787549351 1.05
tpch_q11/duckdb:vortex-file-compressed 545974219 644238398 0.85
tpch_q12/duckdb:vortex-file-compressed 934414806 1013979320 0.92
tpch_q13/duckdb:vortex-file-compressed 561703117 616078295 0.91
tpch_q14/duckdb:vortex-file-compressed 445583759 569569318 0.78
tpch_q15/duckdb:vortex-file-compressed 385059049 392485695 0.98
tpch_q16/duckdb:vortex-file-compressed 407123405 358356035 1.14
tpch_q17/duckdb:vortex-file-compressed 1045451554 950840774 1.10
tpch_q18/duckdb:vortex-file-compressed 725947303 801740941 0.91
tpch_q19/duckdb:vortex-file-compressed 609687135 578081953 1.05
tpch_q20/duckdb:vortex-file-compressed 1086966311 967900676 1.12
tpch_q21/duckdb:vortex-file-compressed 1385079833 1418379931 0.98
tpch_q22/duckdb:vortex-file-compressed 341027823 407569640 0.84
duckdb / parquet (0.885x ➖, 0↑ 0↓)
name PR adef771 (ns) base b6ba850 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 548313527 673344362 0.81
tpch_q02/duckdb:parquet 1144778382 1359013483 0.84
tpch_q03/duckdb:parquet 1108540660 1499320124 0.74
tpch_q04/duckdb:parquet 970729814 785183178 1.24
tpch_q05/duckdb:parquet 1319079194 1703179356 0.77
tpch_q06/duckdb:parquet 550021924 623911779 0.88
tpch_q07/duckdb:parquet 1670735926 1638501741 1.02
tpch_q08/duckdb:parquet 1795264084 2130851783 0.84
tpch_q09/duckdb:parquet 1621818395 1626066463 1.00
tpch_q10/duckdb:parquet 1516117668 1515537609 1.00
tpch_q11/duckdb:parquet 821410970 769620287 1.07
tpch_q12/duckdb:parquet 953230388 1115695220 0.85
tpch_q13/duckdb:parquet 964771807 1155118769 0.84
tpch_q14/duckdb:parquet 703770089 873451592 0.81
tpch_q15/duckdb:parquet 639191556 683292973 0.94
tpch_q16/duckdb:parquet 666935228 815487322 0.82
tpch_q17/duckdb:parquet 989715738 1156574359 0.86
tpch_q18/duckdb:parquet 986195243 1066010801 0.93
tpch_q19/duckdb:parquet 907249137 1280797996 0.71
tpch_q20/duckdb:parquet 1227883491 1461953890 0.84
tpch_q21/duckdb:parquet 1161921292 1404183758 0.83
tpch_q22/duckdb:parquet 713725380 711532016 1.00

@a10y Linear Code

a10y commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Crazy how much faster DuckDB is than DF for these queries

AdamGS added 2 commits June 23, 2026 18:13
@AdamGS
Add clickbench-sorted benchmark
ef01649 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
better datagen
f8cac25 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
AdamGS force-pushed the adamg/clickbench-sorted-benchmark branch from 5fc5ff0 to f8cac25 Compare June 23, 2026 17:13
@AdamGS

AdamGS commented Jun 23, 2026

Copy link
Copy Markdown
Contributor Author

Crazy how much faster DuckDB is than DF for these queries

I think its a pushdown thing? I'll try and enable full pushdown for DF-parquet in a separate PR.

@AdamGS
AdamGS merged commit f793584 into develop Jun 23, 2026
76 of 77 checks passed
@AdamGS
AdamGS deleted the adamg/clickbench-sorted-benchmark branch June 23, 2026 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes
@a10y a10y Awaiting requested review from a10y

Assignees

No one assigned

Labels

changelog/ci

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@AdamGS @a10y @robert3005